Estimating Student Proficiency Using an Item Response Theory Model
نویسندگان
چکیده
Item Response Theory (IRT) models were investigated as a tool for student modeling in an intelligent tutoring system (ITS). The models were tested using real data of high school students using the Wayang Outpost, a computer-based tutor for the mathematics portion of the Scholastic Aptitude Test (SAT). A cross-validation framework was developed and three metrics to measure prediction accuracy were compared. The trained models predicted with 72% accuracy whether a student would answer a multiple choice problem correctly.
منابع مشابه
A Dynamic Mixture Model to Detect Student Motivation and Proficiency
Unmotivated students do not reap the full rewards of using a computer-based intelligent tutoring system. Detection of improper behavior is thus an important component of an online student model. To meet this challenge, we present a dynamic mixture model based on Item Response Theory. This model, which simultaneously estimates a student’s proficiency and changing motivation level, was tested wit...
متن کاملBack to the basics: Bayesian extensions of IRT outperform neural networks for proficiency estimation
Estimating student proficiency is an important task for computer based learning systems. We compare a family of IRTbased proficiency estimation methods to Deep Knowledge Tracing (DKT), a recently proposed recurrent neural network model with promising initial results. We evaluate how well each model predicts a student’s future response given previous responses using two publicly available and on...
متن کاملThe Sensitivity of Value-Added Modeling to the Creation of a Vertical Score Scale
The purpose of this study was to evaluate the sensitivity of value-added modeling to the way an underlying vertical score scale has been created. Longitudinal item-level data was analyzed with both student and school-level identifiers for the entire state of Colorado between 2003 and 2006. Eight different vertical scales were established on the basis of choices made for three key variables: Ite...
متن کاملBayesian inference for an item response model for modeling test anxiety
Wedevelop aBayesian binary ItemResponseModel (IRM),whichwedenote as Test Anxiety Model (TAM), for estimating the proficiency scores when individuals might experience test anxiety. We consider order restricted item parameters conditionally to the examinees’ reported emotional state at the testing session.We consider three test anxiety levels: calm, anxious and very anxious. Using simulated data ...
متن کاملT-SKIRT: Online Estimation of Student Proficiency in an Adaptive Learning System
We develop T-SKIRT: a temporal, structuredknowledge, IRT-based method for predicting student responses online. By explicitly accounting for student learning and employing a structured, multidimensional representation of student proficiencies, the model outperforms standard IRTbased methods on an online response prediction task when applied to real responses collected from students interacting w...
متن کامل